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Section 7 



Stopping times, Wald's identity. 
Another proof of SLLN. 

Consider a sequence {Xi)i>i of independent r.v.s and an integer valued random variable V € {1,2,...}. 
We say that V is independent of the future if {V < n} is independent of cr{{Xi)i>n+i)- We say that F is a 
stopping time (Markov time) if {V^ < n} e <y{Xi, . . . ,X„) for all n. Clearly, a stopping time is independent 
of the future. An example of stopping time is V = min{fc > I, Sk > 1}. 
Suppose that V is independent of the future. We can write 

ESv = Yl ^^vKV =k) = Y^ ESkI{V = A:) 
fe>i fe>i 

= KXnl{V = k) H =k) = Y, EX„I(y > n). 

k>l n<k n>l k>n n>l 

In (*) we can interchange the order of summation if, for example, the double sequence is absolutely summable, 
by Fubini-Tonelh theorem. Since V is independent of the future, the event {V > n} = {V < n — 1}° is 
independent of f7(X„) and we get 

E5y = ^EX„ xP(F>n). (7.0.1) 

This implies the following. 

Theorem 14 (Wald's identity.) If {Xi)i>i are i.i.d., E\Xi \ < oo and EV < oo, then ESy = EXiEV. 
Proof. By (7.0.1) we have, 

ESv = J2 >n)= EXi J2 ^(^ >n)= EXi EV. 

n>l n>l 

The reason we can interchange the order of summation in (*) is because under our assumptions the double 
sequence is absolutely summable since 

^ ^E|X„|I(y = k) = ^E|X„|I(y > n) = E\Xi\EV < oo, 

n>l k>n n>l 

SO we can apply Fubini-Tonelli theorem. 

□ 

Theorem 15 (Markov property) Suppose that {Xi)i>i are i.i.d. and V is a stopping time. Then {V,Xi,. . . , Xy) 
is independent of {Xv-i-i,Xv+2, ■ ■ •) and 

{Xy+l, Xv+2, ■ ■ •) {Xi,X2, . . .), 
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where means equality in distribution. 



Proof. Given a subset A/' C N and sequences (-Bj) and (Cj) of Borel sets on M, define events 

A= |y G N,Xi G Bi,...,Xv G Bv} 



and for any A; > 1, 
We have, 

where 

The intersection of events 



D — G Ci, ...,Xv+k € Cfej. 

V{DA) = ^ P {DA{V = n}) = ^ P (£»„vl{y = n}) 



n>l n>l 



Dn — {Xn+l € Ci, . . . , X„_|_fe G Cfe}. 



" \ {V' = n, Xi G Bi , . . . , X„ G 5„}, otherwise. 

Since V is a stopping time, {V = n} G cr(Xi, . . . ,X„) and A{V = n} G f7(Xi, . . . On the other hand, 

Dn G a{Xn^i, . . .) and, as a result, 

P(Z)A) = ^P(i?„)P(^{y = n}) = ^P(Z)o)P(^{^ = n}) = P(i?o)P(^), 

n>l n>l 

and this finishes the proof. 

□ 

Remark. One could be a little bit more careful when talking about the events generated by a vector 
(y, Xi, . . . , Xv) that has random length. In the proof we implicitly assumed that such events are generated 
by events 

^= |fg7V,Xi G g Sy} 

which is a rather intuitive definition. However, one could be more formal and define a cr-algebra of events 

generated by (V, Xi, . . . , Xy) as events A such that An < n} G cr(Xi, . . . , X„) for any n > 1. This means 
that when V < n the event A is expressed only in terms of Xi, . . . It is easy to check that with this 
more formal definition the proof remains exactly the same. 

□ 

Let us give one interesting application of Markov property and Wald's identity that will yield another 
proof of strong law of large numbers. 

Theorem 16 Suppose that (Xj)j>i are i.i.d. such that EXi > 0. If Z = inf„>i5'„ then ¥{Z > — oo) = 1. 
(Partial sums can not drift down to — oo ifKXi > 0. Of course, this is obvious by SLLN.) 

Proof. Let us define (see figure 7.1), 

n = min{fc >l,Sk> 1}, Zi = min Sk, S'f ^ = Sr^+k - Sr^, 

fc<Ti 

= min {k > 1, > l} , Z, = min S^^\ 5^ = - S^f . 

By induction, 

r„ = min {k > 1, > l} , Z„ = min S^-\ 5'"+^) = 8^% - S^^J. 
Zi,..., Zn are i.i.d. by Markov property. 
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Figure 7.1: A sequence of stopping times. 



Notice that, by construction, Sr 



> n — I and 



We have, 



Therefore, 



Z = inf Sk = mf{Zi,Sri + ^2, S'^+rs + Z3, ...}. 

fc> 1 



{Z <-N}^\J {Sr,+...+r,^, +Zk<-N}C\J{k^l + Zk< -N}. 



k>l 



k>l 



{Z < -N) < ^ P(fc - 1 + ^fc < -N) = V{Zk <-N-k+l) 



k>l 



k>l 



^P(Zi<-iV-fc+l)- ^P(Zi<-j)< ^P(|^i|>j) 

j>N j>N 



N- 



k>l 



if we can show that E|Zi| < 00 since 



Y,n\zi\>j)<nzi\<cx,. 



We can write 



E|Zi| < ^'"^ElXilEri < 00 



if we can show that Eri < 00. This is left as an exercise (hint: truncate Xi's and ti and use Wald's identity). 
We proved that P(Z < -N) which, of course, impHes that V{Z > —00) = 1. 

n 

This result gives another proof of the SLLN. 
Theorem 17 If {Xi)i>i are i.i.d. and EXi = then ^ ^ a.s. 

Proof. Given e > we define Xf — Xi + e so that ¥.X{ = e > 0. By the above result, inf„>i(S'„ + ne) > —00 
with probability one. This means that for all n > 1, Sn + ne > —M > — cxd for some large enough M. 
Dividing both sides by n and letting n —^ 00 we get 

liminf — > — e 

n — >oo fi 

with probability one. We can then let e ~> over some sequence. Similarly, we prove that limsup^ < 
with probability one. 

a 
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